Job Title: ETL Developer / Snowflake Data Engineer
Location: Jersey City, NJ (Onsite Weekly Once)
Duration: Contract
Job Description:
The ETL Data Engineer supports data collection, transformation, and loading efforts across the center, including data deriving from and transferred to statistical as well as geographic information system workflows. This involves establishing ETL workflows to support projects across the center; identifying and evaluating data sources for quality, reliability, and appropriateness; and migrating and integrating datasets as needed for analysis.
Department Specific Responsibilities
- Develops, tests, and integrates ETL routines (including those for geospatial data) using ETL tools and external programming/scripting languages as necessary.
- Automates GIS analysis tasks using Python, ModelBuilder, FME, T-SQL and/or SSIS.
- Creates and maintains the organization data dictionary as well as technical documentation for source-to-target mapping.
- Assists in production support by resolving source data issues and refining transformation rules to align with center objectives.
- Ensures accuracy and integrity of data through analysis of application coding deliverables, ensuring adequate documentation and problem resolution.
- Reviews and approves analysis and translation of functional specifications and change requests into technical specifications.
- Oversees project document management of ETL technical system specifications, processes flows, unit tests and results.
- Ensures staff’s support of all ETL jobs for schedules and maintains compliance in development for effective project life cycle.
- Manages internal resources to ensure that individuals assigned to projects have the specific skills necessary to run established workflows.
- Assists in the design of data collection and analysis efforts with a focus on preventing redundancies, improving quality, and developing systems to support longitudinal data collection and analysis.
General Responsibilities
- Performs data management tasks, including experienced data modeling, conversion, de-duplication, migration, and identification and repair of data quality issues.
- Designs, develops, and implements custom data systems and reconciliation tools, processes, rules, solutions etc. to validate data, match/merge, and upload batch lists.
- Creates and tunes complex stored procedures and queries for data management and extraction.
- Designs and builds out technical software mechanisms to accommodate multiple integrations accurately based on complex rules and custom solutions.
- Ensures documentation and security standards/protocols are recognized and followed.
- Provides experienced troubleshooting and problem analysis/resolution for data related issues; performs experienced scripting and modifications of application and products for corrective action.
- Researches and stays up-to-date with data engineering best practices and approaches; stays abreast of latest security threats and risks to proactively address potential exposures.
